SYSTEM AND METHOD FOR RETRIEVING INFORMATION WHILE COMMANDING 

OPERATION OF AN APPLIANCE 

PRIORITY DATA 

This application is a continuation of and claims the benefit of U.S. Application Serial 
No. 10/176,315 filed on June 20, 2002 

BACKGROUND 

This invention generally relates to platforms having a display and communication 
capabilities such as PDAs, Web Tablets, touch screen remote controls, personal computers, 
and the like. 

SUMMARY 

A system and method for retrieving information is described. Generally, a command 
key of a platform has an operation and an address of an information source mapped thereto. 
When the command key is activated, the platform performs the operation and also initiates 
the retrieval of information from the information source using the address. In an illustrated 
example, the operation results in the platform transmitting a command to cause a tunable 
device, such as a television, VCR, cable box, PVR, or the like, to tune to a channel associated 
with a content provider. The address may be used to access an information source, such as a 
Web page, associated with the content provider. 

A better understanding of the objects, advantages, features, properties and 
relationships of the invention will be obtained from the following detailed description and 
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accompanying drawings which set forth illustrative embodiments that are indicative of the 
various ways in which the principles of the invention may be employed. 

BRIEF DESCRIPTION OF THE DRAWINGS 
5 For a better understanding of the various aspects of the invention, reference may be 

had to preferred embodiments shown in the attached drawings in which: 

Figures 1-3 illustrate screen shots of an exemplary graphical user interface for 
displaying retrieved information and for commanding the operation of an appliance; and 

Figures 4-14 illustrate screen shots of an exemplary graphical user interface used to 
10 setup a device to retrieve information. 

DETAILED DESCRIPTION 
With reference to the figures, wherein like reference numerals refer to like elements, 
a system and method for retrieving information while commanding operation of an appliance 

15 is described. Generally, the system resides on a platform, such as a Web tablet, PDA, 
personal computer, remote control, or the like, adapted to transmit commands to an 
appliance. The platform is also adapted to communicate with a source of information, for 
example, a Web site via the Internet. In this regard, the platform may have hardware and 
software that allows the platform to communicate directly with the source of information 

20 and/or hardware and software that facilitates indirect communication with the source of 
information, for example, via a personal computer acting as an intermediate gateway to a 
network server. 
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By way of more specific example, the underlying platform may include a processor 
coupled to a memory system comprising a combination of ROM memory, non-volatile 
read/write memory, and RAM memory (a memory system); a key matrix, mouse, "graffiti" 
handwriting input pad, or other input device that accepts input from the user; an internal 
5 clock and timer; a transmission circuit; a power supply; a display (which may be a touch 
screen display in lieu of or in addition to the input device) to provide visible feedback to the 
user; and I/O circuitry for allowing the device to exchange communications with an external 
computer such as server and/or an intermediate gateway. As noted previously, representative 
platforms include, but are not limited to, devices such as remote controls, lap-top computers, 

10 Web Tablets and/or PDAs manufactured by Compaq, HP, Palm, Visor, etc. 

The memory system includes executable instructions that are intended to be executed 
by the processor to control the operation of the platform. In this manner, the processor may 
be programmed to control the various electronic components within the device, e.g., to 
monitor power, to cause the transmission of signals, etc. Within the memory system, the 

15 ROM portion of memory is used to store fixed programming and data that remains 

unchanged for the life of the product. The non- volatile read/write memory, which may be 
FLASH, EEPROM, battery-backed up RAM, "Smart Card," memory stick, or the like, is 
provided to store consumer entered setup data and parameters, downloaded data, additional 
programming, etc., as necessary. RAM memory is used by the processor for working storage 

20 as well as to hold data items which, by virtue of being backed up or duplicated on an external 
computer are not required to survive loss of battery power. While the memory system is 
described as comprising all three classes of memory, it will be appreciated that, in general, 
such a memory system need not necessarily support all three, and can be comprised of any 



type of computer-readable media, such as ROM, RAM, SRAM, FLASH, EEPROM, or the 
like in combination. Preferably, however, at least part of the memory system should be non- 
volatile or battery backed such that basic setup parameters and operating features will survive 
loss of battery power. In addition, such memories may take the form of a chip, a hard disk, a 
5 magnetic disk, and/or an optical disk without limitation. 

For commanding the operation of appliances of different makes, models, and types, 
the memory system may include a command code library. The command code library is 
comprised of a plurality of command codes that may be transmitted from the platform for the 
purpose of controlling the operation of an appliance. The memory system may also includes 

10 instructions which the processor uses in connection with the transmission circuit to cause the 
command codes to be transmitted in a format recognized by an identified appliance. While 
the transmission circuit preferably utilizes infrared transmissions, it will be appreciated that 
other forms of wired or wireless transmissions, such as radio frequency, may also be used. 

To identify appliances by type and make (and sometimes model) such that the device 

15 is adapted to transmit recognizable command codes in the format appropriate for such 
identified appliances, information may be entered into the platform. Since methods for 
setting up a platform to control the operation of specific appliances are well-known, they will 
not be described in greater detail herein. Nevertheless, for additional details concerning 
setup operations the reader may turn to U.S. Patent Nos. 6,225,938, 4,623,887, 5,872,562, 

20 5,614,906, 4,959,810, 4,774,51 1, and 4,703,359 which are incorporated herein by reference 
in their entirety. 

To cause the platform to perform an operation, the platform is adapted to be 
responsive to events, such as a sensed interaction with one or more keys on the key matrix, 
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with the touch screen display, or a signal from an external source such as a remote computer. 
More specifically, in response to an event, appropriate instructions within the memory 
system are executed. For example, when a hard or soft command key is activated on the 
platform, the platform may read the command code corresponding to the activated command 
5 key from the memory system and transmit the command code to an appliance in a format 
recognizable by the appliance. It will be appreciated that the instructions within the memory 
system can be used not only to cause the transmission of command codes to appliances but 
also to perform local operations. While not limiting, local operations that may be performed 
by the device include favorite channel setup, macro button setup, command function key 

10 relocation, etc. Examples of local operations can be found in U.S. Patent Nos. 5,481,256, 
5,959,751, 6,014,092, which are incorporated herein by reference in their entirety. 

As discussed, the platform comprises a general purpose, processor system which is 
controllable by software. The software may include routines, programs, objects, 
components, and/or data structures that perform particular tasks that can be viewed as an 

15 operating system together with one or more applications. The operating system, such as the 
"Windows CE" or "Windows XP" brand operating system or the like, provides an underlying 
set of management and control functions which are utilized by applications to offer consumer 
functions such as calendar, address book, spreadsheet, notepad, etc., as well as control of 
appliances. Additional applications can be provided for use in accessing Internet data, 

20 displaying TV guide information, and the like. Thus, it should be understood that, in terms 
of the internal software architecture, a "remote control" application may be but one of several 
possible applications which may co-exist within the platform. It should also be understood 
that in terms of providing operating system functionality, the demarcation between a 



platform and a host/client PC may vary considerably from product to product - at one 
extreme the platform may be nothing more than a slave display and input device in wireless 
communication with a PC that performs all computational functions and, at the other 
extreme, the platform may be a fully-functional PC system in its own right complete with 

5 local mass storage. It will also be appreciated that in an alternative embodiment, a similar 
hardware platform to that described above may be used in conjunction with a scaled-down 
operating system to provide remote control functionality only, i.e., as a standalone 
application. In all cases, however, the principles expressed herein remain the same. 

To provide a means by which a consumer can interact with the platform, the platform 

10 is provided with software that implements a graphical user interface. The graphical user 
interface software may also provide access to additional software, such as a browser 
application, that is used to display to the consumer items that may be retrieved from local 
memory or from an external computer. Such a graphical user interface system is described in 
pending U.S. Applications 60/264,767, 60/334,774, and 60/344,020 all of which are 

15 incorporated herein by reference in their entirety. The browser application may comprise an 
integral extension of the graphical user interface software, or may be a separate program 
supplied as part of the underlying operating system or its accompanying utility software and 
accessed via a standardized interface such Microsoft's COM (Component Object Module) 
technology. 

20 The graphical user interface may also be used to provide a system and method for 

displaying information that is retrieved in response to the receipt of an event commanding the 
platform to perform an operation. The event may direct the platform to perform a local 
operation and/or an operation to transmit a command to an appliance. For example, with 



reference to Figs. 1-3, the graphical user interface can be used to display one or more pages 
(A, B, and C) of selectable command icons 12 by which the user may, among other things, 
generate events to control the operation of the platform where: page A is provided as a means 
by which a user may place the platform in a mode to control a selected appliance; page B is 
5 provided as a means by which a user may direct the transmission of commands to the 

selected appliance; and page C provides a means by which a user may cause the transmission 
of commands to tune an appliance to a designated favorite, such as a favorite television 
program. As this aspect of the graphical user interface is described in detail in the 
incorporated pending U.S. Applications 60/264,767, 60/334,774, and 60/344,020 it will not 

10 be described further herein. 

The graphical user interface may also provide an area within a display, such as 
window 14, in which information is presented to the user. For example, Figure 1 illustrates 
information in the form of a "PBS" Web page that was retrieved via the Internet (either 
directly of via an intermediate gateway) in response to the user activating command icon 16 

15 that was programmed to cause the transmission of a command to tune an appliance, such as a 
television, to the channel on which PBS is broadcast. Figure 2 similarly illustrates 
information in the form of an "NBC" Web page that was retrieved via the Internet in 
response to the user activating command icon 18 that was programmed to cause the 
transmission of a command to tune an appliance, such as a television, to the channel on 

20 which NBC is broadcast. Figure 3 also illustrates information in the form of a "Disney" Web 
page that was retrieved via the Internet in response to the user activating command icon 20 
that was programmed to cause the transmission of a command to tune an appliance, such as a 
television, to the channel of which the Disney station is broadcast. 



To setup the platform to retrieve information, exemplary steps are illustrated in 
Figures 4-14. In the example, the user interacts with the platform to indicate a desire to setup 
the platform to transmit user-specified command codes in addition to retrieving information. 
This desire may be indicated by the user selecting a general setup command icon 22 as 
5 illustrated in Figure 4. In response to the selection of the setup command icon 22, the user 
may be presented with an optional menu 24, illustrated in Figure 5, by which the user may 
further specify a desire to setup one or more features of the platform. In this case, the user 
indicates a desire to add a command icon to the favorites page (i.e., page C of the exemplary 
graphical user interface). This, in turn, commences a setup wizard 26, illustrated in Figures 

10 6-12, that guides the user through the procedure for setting up the command icon to-be-added 
to the graphical user interface. 

The setup wizard 26 may first present to the user a general information page, 
illustrated in Figure 6, followed by an instruction page that directs the user to enter one or 
more keystrokes (i.e., activations of hard key(s) and/or command icon(s) in the form of soft 

15 keys) which cause the platform to perform one or more operations which operations the 
platform is to repeat when the to-be-added command icon is activated. As will be 
appreciated, the keystrokes may be used to command the platform to transmit command 
codes, cause the platform to perform a local operation, or the like. In the example illustrated 
in Figure 8, the keystroke assignment process is used to indicate a desire to have the 

20 platform transmit command codes to an appliance to tune the appliance (e.g., a television as 
indicated by the mode command icon 28) to a desired channel number (e.g., channel "07" 
resulting from the activation of command icon "0" followed by the activation of command 
icon "7" followed by activation of the wrench icon 22 used to signify the end of sequence). 



Once the end of the operational sequence is reached, a further menu 30, illustrated in Figure 
9, may be presented to the user to allow the user to edit the sequence, indicate that the 
sequence is acceptable, test the sequence, etc. To further allow for the testing of the 
sequence, the platform can perform operations in accordance with the keystrokes as the user 
5 enters the keystrokes during the setup procedure. In the example provided, this would result 
in the platform transmitting the commands to tune the television to channel 7 as the user sets 
up the to-be-added command icon. It will be appreciated that operations to be assigned to the 
to-be-added command icon can also be specified by means of menu selections or the like and 
need not be limited to keystroke tracking. 

10 Once the user has indicated to the platform the operations to assign to the to-be-added 

command icon, the user may select how the to-be-added command icon will appear to the 
user in the graphical user interface. To this end, the user may enter a text label to be 
associated with the to-be-added command icon as illustrated in Figure 10 and/or select an 
image for the to-be-added command icon as illustrated in Figure 1 1 . The images may be 

15 selected by scrolling, for example, through an image library having preloaded, downloaded 
via the Internet, and/or user created icon images. Once the image has been selected and/or 
created, the user may then enter an address for an information repository that is to be 
accessed when the to-be-added icon is activated. While illustrated in Figure 12 as the URL 
of a Web site on the Internet, it will be appreciated that the information repository can have a 

20 local or remote address and that the addressing scheme need not be limited to the use of 
URLs. Rather, any known or future developed addressing scheme would be supported. 

When the user has finished the entering of the address of the information repository, 
for example by activating the next icon in the address entry screen 26a of the setup wizard 



26, the to-be-added icon is then added to the favorites page, page C, as an activatable 
command icon 30 as illustrated in Figure 13. In this manner, in keeping with the example 
provided, subsequent activation of the command icon 30 by the user results in the 
transmission of the command codes to tune a television to channel 7 and also the issuing of a 
5 request to retrieve information from the specified address, here "www.abc.com." Any 

information retrieved from the specified information repository is presented in window 14 as 
illustrated in Figure 14. 

Since the exemplary window 14 may be adapted to present markup language content 
as is common in Web pages, the user should also be provided with the ability to interact with 

10 any displayed information to retrieve further information, for example, by clicking on a 

hyperlink 32 presented in a retrieved Web page. Conventional Web browser forward 34 and 
back 36 command icons may be activated to navigate through a series of retrieved 
information pages. A windowing command icon 38 may also be activated to toggle the 
window 14 between a collapsed state (i.e., generally remove it from the display) and an 

15 active state (i.e., to return the window to the display). 

In the case where the user has not specified an address for the information repository, 
a default address can be used or no retrieval action performed. The default address can be a 
predetermined address that is mapped to a specific label and/or image in the image library 
which address is used when the corresponding label and/or image is selected for a to-be- 

20 added command icon. For example, the web address of a content provider (e.g., 

"www.espn.com") can be mapped as the predefined Web address for an icon image that 
depicts the network logo of the content provider. The predefined address could also be a 
manufacturer Web address which would take the user to information pages, registration 



pages, etc. of the manufacturer of the platform, the platform software provider, or the 
appliance to be commanded. When predefined addresses are utilized, these addresses may be 
presented to the user in the address setup screen to allow the user to change the address. 
Alternatively, a predefined address can be unalterable in which case the step of allowing a 
5 user to enter the address would be skipped. 

Still further, the described process need not be limited to setting up addresses when 
adding command icons to the favorites page. Rather, any command icon may be available to 
be setup such that activation of that command icon also retrieves information from an 
information repository. For example, activation of a command icon in the device mode 

10 wheel of page A can cause the platform to enter a mode for commanding an appliance and to 
retrieve information related to that appliance, e.g., the platform may address 
"www.sony.com" in the event the TV mode icon 28 is used to place the platform in a mode 
to command a "Sony" brand television. Similarly, the favorites page of page C can display a 
group of predetermined images of command icons that the user can setup to access 

15 information (and, if need be, to transmit appropriate command codes). It is contemplated 
that, in the case where cable operators provide the platform to customers, some or all of the 
favorites page may be pre-populated with command icons that may or may not have preset 
addresses mapped thereto. 

By way of further example, it is contemplated that operations performed in 

20 connection with an electronic program guide ("EPG") could also result in accessing of 

information. In this regard, as described in the referenced co-pending patent applications, an 
EPG may be displayed on the platform and selection/activation of a channel identifier (e.g., 
"ABC 2") may be used to cause the platform to transmit a command to tune a target 



appliance to the channel on which "ABC 2" is broadcast. It will be appreciated that in some 
circumstances this would cause the device to transmit a command to actually tune the target 
device to channel 2 and in other circumstances to transmit a command to tune the target 
device to another broadcast channel (either user programmed or specified in the content of 
5 the EPG) on which the service provider is carrying the content for "ABC 2" (i.e., channel 7 
on the cable affiliate of the user). In connection with transmitting this command code, 
activation of the channel designating command icon in the EPG could also cause the platform 
to access information pertaining to the selected content provider. For example, the user 
could designate, using the methodology described above, that activation of the command 

10 icon "ABC" in the EPG additionally directs the platform to retrieve information from the 
national broadcaster of the content (e.g., "www.abc.com") or information from the local 
broadcaster of the content (e.g., from the local Los Angelas Affiliate Web site). While the 
user could program the platform to access information at a specified address, address 
information to be linked to an EPG operational icon could also be provided in connection 

15 with the downloading of the EPG into the platform. Any such downloaded address 

information may or may not be user editable. In any event, since the user would typically 
specify to the EPG provider their media service provider(s) for the purpose of populating the 
EPG, this information could also be used by the EPG provider to link addresses to broadcast 
station identifiers which addresses are used to access information when the broadcast station 

20 identifier icons in the EPG are selected to transmit commands to tune an electronic device to 
a desired content provider. 

In addition, while described in the context of video broadcast information retrieval, it 
will be appreciated that other uses of the present invention are contemplated. For example, 



command icons used to tune a radio receiver to a radio station may also be used to access 
information related to the radio station, radio-station programming content, etc. 
Furthermore, since the user may be free to set the address to any desired address, the 
information retrieved is not limited to being associated with the operation to be performed by 

5 the platform in response to activation of the command icon to which the address is 

associated. For example, a viewer can setup a command icon to tune a television to a given 
content provider while activation of the command icon also causes the platform to retrieve 
information from, for example, an on-line auction Web site, such as "www. ebay.com," that is 
unrelated to the content provider. 

10 While specific embodiments of the invention have been described in detail, it will be 

appreciated by those skilled in the art that various modifications and alternatives to those 
details could be developed in light of the overall teachings of the disclosure. For example, 
while described in the context of assigning addresses to command icons, the methods 
described herein can also be used to assign addresses to hard keys. Accordingly, the 

15 particular arrangement disclosed is meant to be illustrative only and not limiting as to the 
scope of the invention which is to be given the full breadth of the appended claims and any 
equivalents thereof. All of the references cited herein are hereby incorporated by reference 
in their entirety. 
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